cacheable-lookup
A cacheable dns.lookup(…)
that respects TTL :tada:
Making lots of HTTP requests? You can save some time by caching DNS lookups :zap:
Usage
Using the lookup
option
const http = require('http');
const CacheableLookup = require('cacheable-lookup');
const cacheable = new CacheableLookup();
http.get('http://example.com', {lookup: cacheable.lookup}, response => {
});
Attaching CacheableLookup to an Agent
const http = require('http');
const CacheableLookup = require('cacheable-lookup');
const cacheable = new CacheableLookup();
cacheable.install(http.globalAgent);
http.get('http://example.com', response => {
});
API
new CacheableLookup(options)
Returns a new instance of CacheableLookup
.
cache
Type: Map
| Keyv
Default: new Map()
Custom cache instance. If undefined
, it will create a new one.
Note: If you decide to use Keyv instead of the native implementation, the performance will drop by 10x. Memory leaks may occur as it doesn't provide any way to remove all the deprecated values at once.
options
Type: object
Default: {}
Options used to cache the DNS lookups.
options.maxTtl
Type: number
Default: Infinity
The maximum lifetime of the entries received from the specifed DNS server (TTL in seconds).
If set to 0
, it will make a new DNS query each time.
Pro Tip: This shouldn't be lower than your DNS server response time in order to prevent bottlenecks. For example, if you use Cloudflare, this value should be greater than 0.01
.
options.fallbackTtl
Type: number
Default: 1
The lifetime of the entries received from the OS (TTL in seconds).
Note: This option is independent, options.maxTtl
does not affect this.
Pro Tip: This shouldn't be lower than your DNS server response time in order to prevent bottlenecks. For example, if you use Cloudflare, this value should be greater than 0.01
.
options.errorTtl
Type: number
Default: 0.15
The time how long it needs to remember queries that threw ENOTFOUND
(TTL in seconds).
Note: This option is independent, options.maxTtl
does not affect this.
Pro Tip: This shouldn't be lower than your DNS server response time in order to prevent bottlenecks. For example, if you use Cloudflare, this value should be greater than 0.01
.
options.resolver
Type: dns.Resolver | dns.promises.Resolver
Default: new dns.promises.Resolver()
An instance of DNS Resolver used to make DNS queries.
options.customHostsPath
Type: string
Default: undefined
(OS-specific)
The full path to the hosts
file. Set this to false
to prevent loading entries from the hosts
file.
options.watchingHostsFile
Type: boolean
Default: false
If set to true
, it will watch the hosts
file and update the cache.
Entry object
Type: object
address
Type: string
The IP address (can be an IPv4 or IPv6 address).
family
Type: number
The IP family (4
or 6
).
expires
Type: number
Note: This is not present when using the native dns.lookup(...)
!
The timestamp (Date.now() + ttl * 1000
) when the entry expires.
ttl
Note: This is not present when using the native dns.lookup(...)
!
The time in seconds for its lifetime.
Entry object (callback-style)
When options.all
is false
, then callback(error, address, family, expires, ttl)
is called.
When options.all
is true
, then callback(error, entries)
is called.
CacheableLookup instance
servers
Type: Array
The DNS servers used to make queries. Can be overridden - doing so will trigger cacheableLookup.updateInterfaceInfo()
.
lookupAsync(hostname, options)
The asynchronous version of dns.lookup(…)
.
Returns an entry object.
If options.all
is true, returns an array of entry objects.
Note: If entry(ies) were not found, it will return undefined
by default.
hostname
Type: string
options
Type: object
The same as the dns.lookup(…)
options.
query(hostname)
An asynchronous function which returns cached DNS lookup entries.
This is the base for lookupAsync(hostname, options)
and lookup(hostname, options, callback)
.
Note: This function has no options.
Returns an array of objects with address
, family
, ttl
and expires
properties.
queryAndCache(hostname)
An asynchronous function which makes two DNS queries: A and AAAA. The result is cached.
This is used by query(hostname)
if no entry in the database is present.
Returns an array of objects with address
, family
, ttl
and expires
properties.
tick()
Deprecated - it is a noop. Outdated entries are removed automatically.
updateInterfaceInfo()
Updates interface info. For example, you need to run this when you plug or unplug your WiFi driver.
Note: Running updateInterfaceInfo()
will also trigger clear()
!
clear(hostname?)
Clears the cache for the given hostname. If the hostname argument is not present, the entire cache will be cleared.
High performance
Performed on:
- Query:
example.com
- CPU: i7-7700k
- CPU governor: performance
CacheableLookup#lookupAsync x 2,421,707 ops/sec ±1.11% (86 runs sampled)
CacheableLookup#lookupAsync.all x 2,338,741 ops/sec ±1.74% (84 runs sampled)
CacheableLookup#lookupAsync.all.ADDRCONFIG x 2,238,534 ops/sec ±0.94% (89 runs sampled)
CacheableLookup#lookup x 2,298,645 ops/sec ±1.26% (87 runs sampled)
CacheableLookup#lookup.all x 2,260,194 ops/sec ±1.49% (87 runs sampled)
CacheableLookup#lookup.all.ADDRCONFIG x 2,133,142 ops/sec ±1.52% (86 runs sampled)
dns#lookup x 7,272 ops/sec ±0.36% (86 runs sampled)
dns#lookup.all x 7,249 ops/sec ±0.40% (86 runs sampled)
dns#lookup.all.ADDRCONFIG x 5,693 ops/sec ±0.28% (85 runs sampled)
Fastest is CacheableLookup#lookupAsync.all
The package is based on dns.resolve4(…)
and dns.resolve6(…)
.
Why not dns.lookup(…)
?
It is not possible to use dns.lookup(…)
because underlying calls like getaddrinfo have no concept of servers or TTL (caching is done on OS level instead).
Related
License
MIT